Genetic-GNN: Evolutionary architecture search for Graph Neural Networks

نویسندگان

چکیده

Neural architecture search (NAS) has seen significant attention throughout the computational intelligence research community and pushed forward state-of-the-art of many neural models to address grid-like data such as texts images. However, little work been done on Graph Network (GNN) dedicated unstructured network data. Given huge number choices combinations components aggregators activation functions, determining suitable GNN model for a specific problem normally necessitates tremendous expert knowledge laborious trials. In addition, moderate change hyperparameters learning rate dropout would dramatically impact capacity model. this paper, we propose novel framework through evolution individual in large searching space. Instead simply optimizing structures, an alternating process is performed between structures dynamically approach optimal fit each other. Experiments validations demonstrate that evolutionary NAS capable matching existing reinforcement methods both transductive inductive graph representation node classification.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Evolutionary Architecture Search For Deep Multitask Networks

Multitask learning, i.e. learning several tasks at once with the same neural network, can improve performance in each of the tasks. Designing deep neural network architectures for multitask learning is a challenge: There are many ways to tie the tasks together, and the design choices matter. The size and complexity of this problem exceeds human design ability, making it a compelling domain for ...

متن کامل

Simple And Efficient Architecture Search for Convolutional Neural Networks

Neural networks have recently had a lot of success for many tasks. However, neural network architectures that perform well are still typically designed manually by experts in a cumbersome trial-and-error process. We propose a new method to automatically search for well-performing CNN architectures based on a simple hill climbing procedure whose operators apply network morphisms, followed by sho...

متن کامل

Comparison of AI Techniques for Fighting Action Games - Genetic Algorithms/Neural Networks/Evolutionary Neural Networks

Recently many studies have attempted to implement intelligent characters for fighting action games. They used genetic algorithms, neural networks, and evolutionary neural networks to create intelligent characters. This study quantitatively compared the performance of these three AI techniques in the same game and experimental environments, and analyzed the results of experiments. As a result, n...

متن کامل

Architecture Performance Prediction Using Evolutionary Artificial Neural Networks

The design of computer architectures requires the setting of multiple parameters on which the final performance depends. The number of possible combinations make an extremely huge search space. A way of setting such parameters is simulating all the architecture configurations using benchmarks. However, simulation is a slow solution since evaluating a single point of the search space can take ho...

متن کامل

Progressive Neural Architecture Search

We propose a method for learning CNN structures that is more efficient than previous approaches: instead of using reinforcement learning (RL) or genetic algorithms (GA), we use a sequential model-based optimization (SMBO) strategy, in which we search for architectures in order of increasing complexity, while simultaneously learning a surrogate function to guide the search, similar to A* search....

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Knowledge Based Systems

سال: 2022

ISSN: ['1872-7409', '0950-7051']

DOI: https://doi.org/10.1016/j.knosys.2022.108752